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Abstract 

We study the trace functions in orbiford theory for Z-graded vertex 
operator superalgebras and obtain a modular invariance result. More 
precisely, let V be a C2-cofinite Z-graded vertex operator superalgebra 
and G a finite automorphism group of V. Then for any commuting 
pairs (g, h) G G, the ha-trace functions associated to the simple g- 
twisted ^-modules are holomorphic in the upper half plane where a is 
the canonical involution on V coming from the superspace structure of 
V. If V is further g-rational for every g G G, the trace functions afford 
a representation for the full modular group 5X(2,Z). 

1 Introduction 

This work is a continuation of our study of the modular invariance for trace 
functions in orbifold theory. Motivated by the generalized moonshine [N] and 
orbifold theory in physics [DVVV] , the modular invariance of trace functions 
in orbifold theory has been studied for an arbitrary vertex operator algebra 
[DLM3]. This work has be generalized to a | Z-graded vertex operator su- 
peralgebra [DZ2] (also see [H]). In this paper we investigate the modular 
invariance of trace functions in orbifold theory for a Z-graded vertex operator 
superalgebra. 

It is true that many Z-graded vertex operator superalgebra can be ob- 
tained from a | Z-graded vertex operator superalgebra by changing the Vira- 
soro element (cf. [DM2]). In this case we can apply the results from [DZ1] and 
[DZ2] to these Z-graded vertex operator superalgebras without extra work. 
Unfortunately, there are many Z-graded vertex operator superalgebras which 
can not be obtained in this way. So an independent study of Z-graded ver- 
tex operator superalgebra becomes necessary although the main ideas and 
methods in this paper are similar to those used in [Z], [DLM3] and [DZ2]. 

1 Supported by NSF grants, China NSF grant 10328102 and a faculty research grant 
from the University of California at Santa Cruz. 
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There is a subtle difference among these modular invariance results. In 
order to explain this we fix a finite automorphism group of the vertex op- 
erator (super) algebra. We use g and h for two commuting elements in G. 
For the vertex operator superalgebra, there is a special automorphism a of 
order 2 coming from the structure of the superspace. The involution a can 
be expressed as (— 1) F in the physics literature (cf. [GSW], [P]) where F is 
the fermion number. Here is the difference: for a vertex operator algebra, the 
space of all /i-trace on (/-twisted sectors is modular invariant [DLM3], for |Z- 
graded vertex operator superalgebra, the space of all /iu-trace on gcr-twisted 
sectors is modular invariant [DZ2], and for Z-graded vertex operator superal- 
gebra, the space of all /wr-trace on twisted sectors is modular invariant. It 
is worthy to point out that the /icx-trace in the physics literature is called the 
super trace. 

Since the setting and most results in this paper are similar to those in 
[DLM2], [DLM3], [DZ1], and [DZ2], we refer the reader in many places to 
these papers for details. 

The organization of this paper is as follows: In section 2, we review the 
definition of Z-graded vertex operator superalgebra (VOSA) and various no- 
tions of g-twisted modules. Section 3 is devoted to studying the representa- 
tion theory for Z-graded VOSA. We introduce the associative algebra A g (V), 
and investigate the relation between the ^-twisted modules and and A g (V)- 
modules. Section 4 is the heart of the paper. We give the definition of 1-point 
functions on the torus and also establish the modular invariance property of 
it. We prove that for a simple g-twisted module M, g and h are two com- 
muting elements in Aut(V), M is a, /i-stable, then the /icr-trace functions for 
M are 1-point function. Moreover, when V is ^-rational, the collection of 
trace functions associated to the collection of inequivalent simple ha, h sta- 
ble g-twisted V modules form a basis of C(g,h). In Section 5 we discuss an 
example to show the modularity of trace functions. 

2 z-graded vertex operator superalgebras 

Let V — Vg © V\ be Z 2 -graded vector space. For any v e Vj with i — 0, 1 we 
define v — i. Moreover, let e^ v = (—1)™ and e v = (— l) v . 

Definition 2.1 A Z-graded vertex operator superalgebra (Z-graded VOSA) 
is a Z x Z 2 -graded vector space 

V = K = V 5 © Vi = 0(V 5 ,n © V lin ) (wtv = n if v e V n ) 
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together with two distinct vectors 1 G Vg 0; c<j G Vo i2 equipped with a linear 
map 

V^(EndV)[[z,z-% 

v ^ Y(v, z) = Y, v(n)z- n ~ l (v(n) G End V) 

satisfying the following axioms for u,v G V : 
(%) u{n)v = /or sufficiently large n; 
(ii) If u & Vi and v G Vj, i/ien u{n)v G V^ + j /or a// n G Z; 
(raj z) = JoV ) -2)1 = v + J2 n >2 v(—n)lz n ~ l ] 

(iv) SetY(co,z) = Y,nez L i n ) z ~ n ~ 2 then 

[L(m), L(n)\ = (m - n)L(m + n) + ^( m3 ~ m)<Wn,o c (2.1) 
where c G C is called the central charge, and 

L(0)\ Vn =n, nez, (2.2) 
^Y(v,z) = Y(L(-l)v,z); (2.3) 

(v) For ^-homogeneous u,v & V, 

z~ l 5 ( — — — ) y(u, (u, 22) - £u, v zq 1 5 ( — — — ) z 2 )^(«, #l) 

= z^S (^-^Y(Y(u,z )v,z 2 ) 

(2.4) 

where S(z) = Sngz- 2 ™ (^i — z j) n * s expanded in nonnegative powers of Zj 
and zo, z±, z 2 , etc. are independent commuting formal variables. 

Following the proof of Theorem 4.21 of [Z] we can also define Z-graded 
vertex operator superalgebra on a torus associated to V. 

Theorem 2.2 (V, Y[],l, uj) is a Z-graded vertex operator superalgebra, where 
Cj = uj — ^ and for homogeneous v G V 

Y[v, z] = Y(v, e z - l)e zwtv = £ v^z' 71 ' 1 (2.5) 

Let F[cD, z] = J2n£z L[n]z~ n ~ 2 . Then V = nez Vj n ] is again Z-graded and 
L[0] = n on Vj n j. We will write wt[v] = n if v G Vj n j. 

Definition 2.3 A linear automorphism g of a Z-graded VOSA V is called an 
automorphism ofV if g preserves 1, u and each Vj, and 

gY(v,z)g~ 1 = Y(gv,z) 

for dGK 
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Note that if V is a ^-graded vertex operator superalgebra, the assumption 
that g preserves each Vj in unnecessary (cf. [DZ2]). 

We denote the full automorphism group by Aut(V). If we define an action 
, say a on V associated to the superspace structure of V via cr|V| = (— 1)*. 
Then a is a central element of Aut(V) and will play a special role as in [DZ2]. 

Let g be an automorphism of V of finite order T. Then we have the 
following eigenspace decomposition: 

V = ® r& /TzV r (2.6) 

where V r = {v G V\gv = e~ 2mr / T v}. We now give various notions of g— 
twisted V- modules. 



Definition 2.4 A weak g-twisted V -module is a C-linear space M equipped 
with a linear map 

V -> (EndM)[[z 1 / T ,z- 1 / T }} 
v i-> Y M (v,z) = T in eQ v ( n ) z ~ n ~ 1 

which satisfies: 

(i) v(m)w = for v G V,w G M and m » 0; 

(ii) Y M (l,z) = Id M ] 

(in) Forv eV r andO <r <T - 1 



Y M (v,z)= v ( n ) 



y 71—1. 
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(iv) For u G V r , 

— ) Y M (u, Z!)Y M (v, z 2 ) - t u ^ v z~ l 5 — ) Y M (v, z 2 )Y M (u, z x ) 

Zq / V —Zq J 

= (^^) T T S Y M (Y(u,z )v,z 2 ) 

(2.7) 

Set 



Y M (u,z) = J2 L ( n ) 
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Then we have Y M (L(— \)v , z) = -^Y M (v,z) for v G V and L(n) also satisfy 
the Virasoro algebra relation with central charge c (see [DLM1]). 

Definition 2.5 A weak g-twisted V -module M is admissible if it is ^Z + - 
graded: 

M= M(n) (2.8) 

0<ne^Z 
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such that for homogeneous v G V, 

v(m)M(n) C M(n + wtv -m-1) (2.9) 
We may and do assume that M(0) 7^ i/M^O. 

Definition 2.6 A weak g -twisted V -module M is called (ordinary) g-twisted 
V -module if it is a C-graded with 

M=l[M x (2.10) 

Aec 

where M\ = {w G M\L(0)w = \w} such that dim Ma is finite and for fixed 
A, M« + a = for all small enough integers n. 

It is not hard to prove that any ordinary g-twisted ^-module is admissible. 
The notion of weak, admissible and ordinary V-modules is just the special 
case when g — 1. 

If M is a simple g-twisted V-module, then 

00 

M = 0M A+n/T (2.11) 

n=0 

for some A G C such that M\ 7^ (cf. [Z]). A is defined to be the conformal 
weight of M. 

Definition 2.7 (i) A Z-graded VOSA V is called g -rational for an automor- 
phism g of finite order if the category of admissible modules is completely 
reducible. V is called rational if it's 1-rational. 

(ii) V is called holomorphic if V is rational and V is the only irreducible 
V -module up to isomorphism. 

(Hi) V is called g-regular if any weak g-twisted V -module is a direct sum 
of irreducible ordinary g-twisted V -modules. 

As in [DLM2] and [DZ1] we have the following result. 

Theorem 2.8 If V is g-rational Z-graded VOSA with g G Aut(V) being of 
finite order then 

(i) There are only finitely many irreducible admissible g-twisted V -modules 
up to isomorphism. 

(ii) Each irreducible admissible g-twisted V -module is ordinary. 
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3 The associative algebra A g (V) 

In this section we construct the associative algebra A g (V) and study the 
relation between admissible g-twisted V-modules and A g (y)-modu\es. The 
result is similar to those obtained in [DLM2] (also see [Z], [KW], [X], [DZ1]). 

As before we assume that the order of g is T. For < r < T — lwe define 
5 r = S r;0 . Let Og{V) be the linear span of all u o g v, where for homogeneous 
u E V r \d. (2.6)) and v E V, 

(1 + Z ) wtu - 1 + S r + Y 

u o g v = Res 2 Y(u,z)v. (3.1) 

Z r 

Set A g (V) = V/O g (V) and define a second linear product * g on V for the 
above u, v as follows: 

(1 + z ) wtu 

u* g v = Res z Y(u,z) v (3.2) 

z 

if r = and u * g v = if r > 0. It is easy to see that A g (V) is in fact a 
quotient of V°. 

As in [DLM2],[X] and [DZ2] we have 

Theorem 3.1 A g (V) = V/O g (V) is an associative algebra with identity 1 + 
Og{V) under the product * g . Moreover, cu + O g (V) lies in the center of A g (V). 

For a weak g-twisted V-module M, we define the space of the lowest weight 
vectors 

Q(M) = {w e M\u(wtu - 1 + n)w = 0, u e V, n > 0}. 
We have (see [DLM2]): 

Theorem 3.2 Let M be a weak g-twisted V -module. Then 

(i) Q(M) is an A g (V) -module such that v + O g (V) acts as o(v). 

(ii) If M = J2n>o M(n/T) is an admissible g-twisted V -module such that 
M(0) ^ 0, then M(0) C Q(M) is an A g (V)-submodule. Moreover, M is 
irreducible if and only if M(0) = Q(M) and M(0) is a simple A g (V)-module. 

(Hi) The map M — > M(0) gives a 1-1 correspondence between the irre- 
ducible admissible g-twisted V -modules and simple A g (V) -modules. 

We also have (see [DLM2]): 

Theorem 3.3 Suppose that V is a g-rational vertex operator superalgebra. 
Then the following hold: 

(i) Ag{V) is a finite dimensional semisimple associative algebra. 

(ii) V has only finitely many irreducible admissible g-twisted modules up 
to isomorphism. 

(Hi) Every irreducible admissible g-twisted V -module is ordinary, 
(iv) V is g' 1 -rational. 
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4 Modularity of trace functions 

We are working in the setting of section 5 in [DLM3]. In particular, g,h 
are commuting elements in Aut(V) with finite orders o(g) = T,o(h) = Ti, 
A is the subgroup of Aut(V) generated by g and h, N — lcm{T,Ti) is the 

exponent of A, T(T, Ti) is the subgroup of matrices ^ ° ^ ^ in SX(2,Z) 

satisfying a = d = 1 (mod AT), 6 = 0(mod T), c = 0(mod Ti) and M(T, Ti) 
be the ring of holomorphic modular forms on T(T, Ti) with natural gradation 
M(T,7i) = © fc > M A; (T,Ti), where M k (T, Ti) is the space of forms of weight 
fc. Then M(T, Ti) is a Noetherian ring. 

Recall the Bernoulli polynomials -B r (x) G <Q>[x] defined by 

te te _ g S r (a:)i r 



(e*-l) ^ H 
For even k > 2, the normalized Eisenstein series E k (a) is given by 

r? o oo 



Also introduce 



Q k (n,\,q T ) = Q k (n,\,T) 



1 ^ A(n + j/T) k - 1 q?+i/ T 



v A- 1 (n-j/T) fc -y-J/ r j? fc (j/T) 



for (/i, A) = (e^^,e T i ) and (/i, A) 7^ (1, l),when k > 1 and k E Z. Here 
(n + j/T) k ~ l = 1 if n = 0, j = and Jfc = 1. Similarly, (n - j/T) k - 1 = 1 if 
n — l,j — M and /c = 1. We also define 

Qo(a*,A,t) = -1. (4.3) 

It is proved in [DLM3] that E 2k ,Q r are contained in M(T, Ti) for > 2 and 
r > 0. 

Set \/(T, Tx) = M(T,Tx) ® c V.. Given v E V with ^ = ^v, hv = X^v 
we define a vector space 0(g, h) which is a M(T, Ti)-submodule of V(T, Ti) 
consisting of the following elements: 

v[0]w,wEV,(fi,X) = (l,l) (4.4) 
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v[-2]w + £(2A; - l ) E 2k{r) ® v[2k - 2}w, (/i, A) = (1, 1) (4.5) 

k=2 

v,(e v ,fj,,X)^ (1,1,1) (4.6) 

oo 

Qk(», A, r) ® u[A; - l]w, (//, A) ^ (1, 1). (4.7) 

fc=0 

Definition 4.1 Let fj denote the upper half plane. The space of (g, h) 1 -point 
functions C(g, h) is defined to be the C-linear space consisting of functions 

S : ViT,^) x f, -> C 

s.* 

(%) S(v,t) is holomorphic in r /or f G V(T,Ti). 

(ii) S(v, t) is C linear in v and for f G M(T, Ti), v £ V, 

S(f®v,T)=f(r)S(v,T) 

(in) S(v,t) = ifve 0(g,h). 

(iv) If v G V with av = gv = hv = v, then 

oo 

S(L[-2]v, r) = dS(v, r) + £ E 21 {t)S{L[21 - 2}v, r). (4.8) 

1=2 

Here dS is the operator which is linear in v and satisfies 

dS(v, t) = d k S(v, r) = ^~^S(v, r) + kE 2 (r)S(v, r) (4.9) 

forv G V [k] . 

We have the following modular invariance result (see Theorem 5.4 of 
[DLM3]): 

Theorem 4.2 For S G C(g, h) and 7 = ^ ° ^ j GT, we define 

S\7(v,T)=S\ kl (v,T) = (cr + dy'Siv^r) (4.10) 
for v G V[fc], and extend linearly. Then S\~f G C((g, h)^). 

Let 0, h, a, V be as before, and M be a simple o-twisted module. We now 
show how the graded /ia-trace functions on o-twisted K-modules produce 
(g, h) 1-point functions. 

From (2.11), we know that if M is a simple g— twisted module then there 
exists a complex number A such that 

00 

M = 0M A+f (4.11) 

n=0 
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Now we define a (ha)g(ha) 1 -twisted V-module (haoM, YhaoAt) such that 
ha o M = M as vector spaces and 

Yhctom(v,z) = Y M ((ha)~ 1 v,z). 

Since g, h, a commute each other, ha o M is, in fact, a simple g-twisted V- 
module again. The M is called h-stable if ha o M and M are isomorphic 
g-twisted V-modules. In this case, there is a linear map <p{ha) : M — > M 
such that 

##mK zMha)- 1 = Y M {(ha)v, z) (4.12) 

for all ueK 

We now assume that M is /i- stable. For homogeneous t> G V, we define 
the trace function T as follows: 

rf^rM^^^^rtr^v)^)^'-^ (4.13) 

Here c is the central charge of V. Note that for m G |;Z, v(m) maps M M to 
M jU+wt „_ m _i. Hence 

oo 

T(v) = q x ~^ Y, tr M x+n o(v)(f ) (ha)q^ = tr M o{v)(f)(ha)q L ^-^ . (4.14) 
n=0 T 

In order to state the next theorem we need to recall C2-cofinite condi- 
tion from [Z]. V is called C2-cofinite if V/C2(V) is finite dimensional where 
C 2 (V) = {u- 2 v\u,veV}. 

Theorem 4.3 Suppose that V is C^-cofinite, g,h G Aut(V) commute and 
have finite orders. Let M be a simple g-twisted V -module such that M is h and 
a -stable. Then the trace function T M (v, (g, h), q) converges to a holomorphic 
function in the upper half plane \) where q = e 2mT and r G f). Moreover, 
T M eC(g,h). 

The proof of this theorem is similar to Theorem 4.3 of [DZ2] although the 
idea goes back to [Z] and [DLM3]. 

We also have the following theorems. 

Theorem 4.4 Let M 1 , M 2 , ...M s be the collection of in equivalent simple ha 
and a -stable g-twisted V -modules, then the corresponding trace functions T±, 
T 2 ,...T S (4-13) are independent vectors ofC(g,h). Moreover, ifV is g -rational, 
Ti,T 2 , ...T s form a basis ofC(g, h). 

The following theorem is an immediate consequence of Theorem 4.3 and 
Theorem4.4. 
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Theorem 4.5 Suppose that V is a C \- co finite vertex operator superalgebra 
and G a finite group of automorphisms of V. Assume that V is x-rational for 
each x G G. Let v G V satisfy wt[v] = k. Then the space of (holomorphic) 
functions in \) spanned by the trace functions Tm{v, (g,h),r) for all choices 
of g, h in G and a, h-stable M is a (finite- dimensional) SL(2,Z) -module such 
that 

Tm\i(v, (g, h),r) = (cr + dy k T M (v, (g, h),^), 
where 7 G SL(2, Z) acts on f) as usual. 

More precisely, = ^ ^ d ^) ^ SX(2,Z) then we have an equality 

T M (v, (g, h), = (cr + d) k £ -y MtW T w (v, (g a h c , g b h d ),r), 

cr + d w 

where W ranges over the g a h c -twisted sectors which are g b h d and a -stable. 
The constants 7m,w depend only on M, W and 7 only. 

Theorem 4.6 Let V be a rational and C2-cofinite Z-graded VOSA. Let M 1 , 
M 2 ,... M s be the collection of inequivalent simple a -stable V -modules. Then 
the space spanned by 

T t (v,r) = T t (v, (1,1), r) = tr M ,o(v)^a)q L(0 ^ (4.15) 

gives a representation of the modular group. To be more precisely, for any 

7=^^ J j 6 T there exists a s x s invertible complex matrice (7^) such 

that 

Uv, a -^-) = (cT + dY± il3 T J (v,T) 

for all v G Vj n j. Moreover, the matrix (7^) is independent of v. 

Remark 4.7 It is interesting to notice that the modular invariance result 
in Theorem 4-6 is different from that for the vertex operator algebras in [Z] 
and for the ^Z-graded vertex operator superalgebras in [DZ2J. In this case of 
vertex operator algebras, the space of of the graded trace of simple modules is 
modular invariant [Z]. But for the ^Z-graded vertex operator superalgebras, 
the space of the graded a trace on the simple a -twisted modules is modular 
invariant. In the present situation, the space of the graded a trace on the 
simple V -modules is modular invariant. 

One can also obtain the results such as the number of inequivalent , h, a- 
stable simple g-twisted ^-modules and rationality of central charges and con- 
formal weights for rational vertex operator superalgebras as in [DLM3] and 
[DZ2]. 



10 



5 An example 

In this section we consider Z-graded VOSA V ZQ , and its cr-twisted module 
V Za+ i a to demonstrate the modular invariance directly. 

We are working in the setting of Chapter 8 of [FLM2]. Let L = Za be 
a nondegenerate lattice of rank 1 with Z-valued symmetric Z-bilinear form 
( , ) s.t. (a, a) = 1. Set M(l) = C[a(—n)\n > 0] and let C[L] be the group 
algebra of the abelian group L. Set 1 = 1 <g) e° e V L and uo = \a{— l)a(— 1). 

Recall that a vertex operator (super) algebra is called holomorphic if it 
is rational and the only irreducible module is itself. We have the following 
theorem (see [B], [FLM2], [D], [DLMl], [DM1]). 

Theorem 5.1 (i) (Vl,Y,1,u) is a holomorphic ^Z-graded vertex operator 
superalgebra with central charge c = rank(L) = 1. 

(U) (V L )o = M (1) <g> C[2L] and (V L )i = M (1) <g> C[2L + a]. 

(Hi) Vi+\ a is the unique irreducible a -twisted module for V L . 

One can verify the next theorem easily. 

Theorem 5.2 (%) If we let J = \a(-lf ± \a{-2), then (V L ,Y, l,u') is a 
holomorphic Z-graded vertex operator superalgebra with central charge d = 
-2. 

(ii) V L+ i a is the unique irreducible a-twisted module for Z-graded vertex 
operator superalgebra Vl- 

We consider the group G to be the cyclic group generated by a. It is 
straightforward to compute the following trace functions: 

T(l,(l,l),T)=tr Vza aq L W-^ 

oo oo 

7Z=0 S— — OO 

T(l,(l,a),r) = tr Vla q L '^ 
= g s ^ P(n)g™ 

n=0 s=— oo 

= i7(r)- 1 e 2 (?), 

r(l,( < 7, < 7),r)=trv W4 yW-^ 
= g ia )^P(n)g n ^ g 

n=0 s=— oo 

= »7(r)- 1 fls(?), 
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where 



oo oo c s _i_ 1 \r s _ l ■) 

= ^na+o E (-i) s q^^- 

n=l s=—oo 

Tl(r) = q* H(l - q n ) 

n>l 

oo 

x (q) = £ (-l) n q^ )2 = 

n=— oo 

oo 

fc(?) = E ? |(n ^ )2 

n=— oo 
oo 

3 (?) = E 



1„2 



n=— oo 
oo 



1„2 



OM = E (-I)"? 5 

n=— oo 

Recall the transformation law for rj functions 

rj(r + 1) = e^rj(r), 77 ( — ) = (— i-r) ^77(7-) 

r 

r+l „<r). 



and relations 



2 (g) = 2 
0s(?) 



77(|)77(2r) 
r / (2r) 2 



77(7-) 
rj(rf 



»7(2r)^(i) 2 



77(r) 

The modular transformation property for T(l, (g, /i),r) for g,h E G can 
easily be verified and the result, of course, is the same as what Theorem 4.5 
claimed. One can also compute the trace functions for the |Z-graded vertex 
operator superalgebra Vl notice that the sets of trace functions in two cases 
are exactly the same. Since Vl and V(H, Z + |) with / = 2 are isomorphic 
iz-graded vertex operator superalgebra (the boson-fermion correspondence) 
one can use the modular invariance result for V(H, Z + \) obtained in [DZ2] 
to check the modular transformation property of the trace functions for the 
Z-graded vertex operator superalgebra Vl- 
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